Food for talk: photo frames to support social connectedness for elderly people in a nursing home

Social connectedness is crucial to someone’s well-being. A case study is conducted to test whether the social connectedness of elderly people living in a nursing home and their family and friends can be improved through a photo frame. A SIM-based photo frame is used to keep the elderly people informed about the comings and goings of their loved ones. Eight elderly people living in a nursing home participated in this case study for 6-7 weeks. A content analysis of the photos revealed that the photos often were related to special events or holidays that happened in the past. Interviews indicated that the photos mainly served as food for talk, i.e. the photos initiated conversations between the elderly people mutually, with their family members and with the healthcare professionals. They all liked the photo frame and it didn’t serve as a means to exchange news, but as a catalyst to talk –mainly- about the past

Towards a Unified Knowledge-Based Approach to Modality Choice

This paper advances a unified knowledge-based approach to the process of choosing the most appropriate modality or combination of modalities in multimodal output generation. We propose a Modality Ontology (MO) that models the knowledge needed to support the two most fundamental processes determining modality choice – modality allocation (choosing the modality or set of modalities that can best support a particular type of information) and modality combination (selecting an optimal final combination of modalities). In the proposed ontology we model the main levels which collectively determine the characteristics of each modality and the specific relationships between different modalities that are important for multi-modal meaning making. This ontology aims to support the automatic selection of modalities and combinations of modalities that are suitable to convey the meaning of the intended message

Robotic Rabbit Companions: amusing or a nuisance?

Most of the studies in human-robot interaction involve controlled experiments in a laboratory and only a limited number of studies have put robotic companions into people’s home. Introducing robots into a real-life environment does not only pose many technical challenges but also raises several methodological issues. And even though there might be a gain in ecological validity of the findings, there are other drawbacks that limit the validity of the results. In this paper we reflect on some of these issues based on the experience we gained in the SERA project where a robotic companion was put in the homes of a few people for ten days. We try to draw some general lessons from this experience

Measuring stress and cognitive load effects on the perceived quality of a multimodal dialogue system

In this paper we present the results of a pilot study investigating the impact of stress and cognitive load on the perceived interaction quality of a multimodal dialogue system for crisis management. Four test subjects interacted with the system in four differently configured trials aiming to induce low/high levels of stress and cognitive load. To measure the level of stress and cognitive load physiological sensors and subjective ratings were collected. After each trial the subjects filled in an evaluation questionnaire regarding the system interaction quality. In the end we conducted an in-depth interview with each subject. The trials were recorded with a webcam to facilitate the behaviour analysis. Results showed that both factors have an influence on the way subjects perceived the interaction quality, whereas the cognitive load seems to have a higher impact. Further quantitative experiments are needed in order to validate the results and quantify the weight of each factor. \u

How the agent’s gender influence users’ evaluation of a QA system

In this paper we present the results of a pilot study investigating the effects of agents’ gender-ambiguous vs. gender-marked look on the perceived interaction quality of a multimodal question answering system. Eight test subjects interacted with three system agents, each having a feminine, masculine or gender-ambiguous look. The subjects were told each agent was representing a differently configured system. In fact, they were interacting with the same system. In the end, the subjects filled in an evaluation questionnaire and participated in an in-depth qualitative interview. The results showed that the user evaluation seemed to be influenced by the agent’s gender look: the system represented by the feminine agent achieved on average the highest evaluation scores. On the other hand, the system represented by the gender-ambiguous agent was systematically lower rated. This outcome might be relevant for an appropriate agent look, especially since many designers tend to develop gender-ambiguous characters for interactive interfaces to match various users’ preferences. However, additional empirical evidence is needed in the future to confirm our findings

How humans behave and evaluate a social robot in real-environment settings

Behavioral analysis has proven to be an important method to study human-robot interaction in real-life environments providing highly relevant insights for developing new theoretical and practical models of appropriate social robot design. In this paper we describe our approach to study human-robot interaction by combining human behavioral analysis with robot evaluation results. The approach is exemplified by a case study performed with a social robot receptionist in real-life settings. Our preliminary results are encouraging, as many behavior categories could be successfully related to certain evaluation patterns. With our analysis we hope to add a useful contribution to social-robotic design concerning user modeling issues and evaluation predictions